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Abstract 

In this paper a hierarchical extension of the Minority Game is defined and 
studied. Numerical simulations show a special type of emergent global behavior 
between separated parts of the hierarchical structure, connected only through a 
normalized mean field quantity. 
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1 INTRODUCTION 

In this paper a simple, single-level strategic game, namely the Minority Game (MG), 
will be extended to form a hierarchical organization. The individual MGs will form a 
group, and individual players within each MG will make decisions which depend on 
the average behavior of their own and other MGs. Calculations show that under certain 
conditions the elements of the individual MGs "know" much more about each other 
than one would expect. 

"...Hierarchical organization is a common way to structure a group of people, where 
members chiefly communicate with their immediate superior and with their immediate 
subordinates. Structuring organizations in this way is useful partly because it can re- 
duce the communication overhead." 1 1 1. 

One of the most interesting questions in the theory of hierarchical systems is how 
much information a subsystem has about the performance of the whole. In addition to 
study this problem the top-down influence of the "whole" system to the elements will 
also be quantitatively studied. 



2 HIERARCHICAL EXTENSION of MG 

MG is a simple model of inductively rational systems |2|. This game is a system of 
TV interacting agents. Each agent brings a decision a, (si(i), n(t)) between +1 and 



1 



— 1 based on her Si(t) strategy and the knowledge of the history of the game /Lt(t). 
In all simulations each agent chooses from one of two stategies which are randomly 
chosen for each agent in the beginning of the game. A strategy is a look-up table which 
assigns the actual choice to the M component vector fi(t) of the previous M outcome 
signs, sgn(A(t)). A(t) is defined as A(t) = J^i a i ( s i(t)> Each agent chooses 

the s strategy from the possible ones with probability 

Prob{ Si (t) = s} = Z i e r ' D '-W (1) 

Where Zf = e TiU " ,tyt \ Tj is the inverse temperature, and the performance of 
the i th agent's s th strategy is evaluated by a cumulative score Ui S (t). The updating 
rule for the evaluation: 

U is (t+1) = U is (t) - a, (si(t), n(t)) A(t) (2) 

The second term represents the gain of the individual agents. 

The original model is extended to form a hierarchical structure. This extension is 
done in the following way. N' original MGs are connected into a new MG, where the 
original MGs are the agents of this new game. In this hierarchical organization there 
are N' (j = 1...N') original MGs, in each of which N (i = 1...N) (low level) agents 
play and where their decision is a,ij(sij(t), Hj(t)). We use [ij since each local MG's 
history contains the local and global minority sign hence it is different for every local 
MG. For simplicity we will denote (si(t), fij(t)) by (t). 

In each low level MG we have an outcome minority sign, — sgn{Aj). From the set 
of these signs a global sum and a minority sign, is defined as A — J2j s 9 n (^j) an d 
— sgn(A). Thus the score updating dynamics of the strategies are modified as: 

U ijs {t + 1) = U ijB {t) - a l3 {t) ^A 3 {t) + cY^sgn {A k {t))^j , (3) 

The constant, C, expresses the ratio of the contribution of the local and global 
environments. The local environment consists of the agents playing in the original MG, 
while the global one is derived from the connection of the MGs. The game among the 
MGs, however, differs from the original. The MGs, as individual agents, don't have 
strategies and memories explicitly. Instead the global connection between the MGs is 
made only through their low level agents. 



When C — > we obtain the original definition. It is often assumed in the theory 
of hierarchical structures that the local interactions should be much stronger than the 
global ones |3|. However, the violation of this assumption implies non-trivial results. 

In the context of MG for values of C when the global interactions are stronger 
than the local ones, the agents don't choose a strategy to maximize their own winning 
chance only, but also to help their whole group win against other groups. 

To be able to analyze our extended multilevel model, we will decompose it into 
three subsystems. Each subsystem contains binary interlayer interactions only, as 
shown in Fig.(l). The characteristic quantities, namely the global efficiency and the 
degree of symmetry, will be properly redefined. 
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Figure 1 : Hierarchical organization of the minority games 



3 RESULTS 

3.1 Interactions between the elementary and intermediate levels 

The new additive part of Eq.(|3j is the same for every elementary participant, therefore 
we expect that the normalized global "waste" cr| /N averaged over the N' MG's (de- 
noted by < cr|/iV >jv) will show the same characteristic pattern as in the original 
game. A small value of the waste implis a high value of efficiency. 

By this extension, however, the total payoff of the j th MG Uj = —A^ — AjA might 
be greater than zero, and thus it is no longer a "negative sum game". 



Fig. (2) shows the results of the comparative studies between the original and the 
special features of the extended game by calculating er^ using the equation 




a) = {A)) = xy* ( ( £ (*) 



(4) 



where P em = 2 is the number of possible memory states, pP* is the probability of 
occurrence of the /ith state in the jth MG. The (...) refers to the averaging over the 
possible strategies and the overline stands for the averages over the memory states. 



3 



Figure 2: < a?/N 
1/N' (left) andC = 



>jv as a function of ctjv = P em /N for various TV's, with C 
1 (right).ry - oo, U ijs {0) = 0, for Vi, j, s. 



The left part of Fig. prefers to the case of C — 1/N' for various values of N'. 
Simulations show that the average of <r? /N deviates from that obtained in the original 
game, but the deviation does not depend on the value of N'. In the right part of Fig. (2) 
(C = 1), the average of cr^/N differs not only from the original characteristics, but is 
different for each value of N'. It is easy to understand this dependence on TV', because 
the additive part in Eq.Q does not implement any normalization. (The order of magni- 
tude of the new additive factor is o(NN'), while the original part of Eq.Q is just o(N). 
For larger values of our new additive part (which is proportional to N') and by the defi- 
nition of MG we obtain larger values of en /N than one would see in the original game. 

A more striking result was obtained for the behavior of the symmetry between the 
two minority signs. Fig.(|3j plots the degree of asymmetry as a function of 
(left) and C (right), respectively. The asymmetry is defined by 



g (sgniAjit))^) 2 (5) 

where (—sgn(Aj(t))\fXj) is the conditional probability of —sgn(Aj(t)) conditioned 
on fij. 

Our numerical results show that the system nowhere became symmetrical for the 
two signs. Indeed in Fig.(|3} we can see that for various Cs and TV's we obtain the 
same characteristics reflecting that there is no phase transition in the system with the 
parameters we investigated. The tendency of the change occurs more slowly than in the 
original game. The difference appears because our subsystems are not closed because 
of the interaction between the MGs. Though there exists an 'optimal strategy' where 
the symmetrical phase should appear, it's efficiency is very low. 




3.2 Interactions between the middle and upper levels 

Our naive expectation is to find 'random players,' i.e. players who select their strate- 
gies randomly, because the choices of the middle level players are just the results of 
minority games of the lower level. These 'choices' cannot be interpreted as the results 
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Figure 3: < 0? >n> as a function of a at for various TV's (left) and Cs (right). ~ oo, 

U ijs (0) = 0, for Vi,j,s. 



of 'decisions' because the middle level does not have any direct memories or strate- 
gies. They are only mean field averages over the individual MGs. Although the lack of 
memory implies the break down of the definition of the original scaled parameter, a^, 
we still found this quantity to be useful. 

We define the waste a^ nu in terms of the variation in each of the middle level games 
(mil is the symbolic notation of "between middle and upper"). Explicitly, we have 





sgn[ya ij (t)A^(t)}A(t) 



(6) 



Note that the last term of Eq.(6) depends on N'. The lack of normalization will not 
have any effect, because we are only interested in the sign of the sum of the local 
agents' performance. 
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Figure 4: o 2 m jN' as a function of = P/JV' for various TV's, with C =1/N' (left) 
and C = 1 (right). T y - oo, £/ ijs (0) = 0, for V s. 



The simulation results reflect the expectations discussed above. For those values of 
C which implement larger local connections within an MG than to the global one (C = 
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1 /N') the system shows random behavior (Fig|4]left). When the global connection gets 
stronger, i.e. C = 1, the system shows an emergent coordination |4|, i.e. the system as 
a whole shows a different than random performance. Fig.(0} (right) shows positive and 
not negative deviation from the random performance. This phenomenon is the result of 
the interaction of the two minority games. 

3.3 Interactions between the elementary and upper levels 

In this case we could ask whether there is any direct connection between the elementary 
and upper levels. Here we calculated different globally averaged functions <j eu and Q\ u 
(where eu the symbolic notation of "between elementary and upper"). We define 

^=7^=fW ) (?) 

m=i \ \i=i »=i / / 

First, we note that there is now another scaled parameter. For P eu = (2^~) N +1 pos- 
sible states of the system the new scaled parameter is 0(n,n' = jfxfr- And /i refers to 

the state of the whole system (i.e. p 11 S ®jLi ®^"=i 




Figure 5: a^ u /(NN') as a function of ctN,N' for various TV's, with C = l/N (left) 
and C = 1 (right). T tJ - oo, U ljs (0) = 0, for V i, j. 



In these numerical simulations (Fig.(|5j) the results are qualitatively the same. (With- 
out normalization the value of u 2 eu l (NN 1 ) increases for greater values of N'.) 

Another interesting result of our investigation is the symmetry at this level. One 
might believe that d\ u would not depend on either N' or C, explicitly. However, the 
simulation result (Fig|6j still shows some dependence on N' and C. 



4 Discussion 

We studied a hierarchical extension of the MG for three levels and studied the inter- 
level interactions. First, the local MGs, i.e. the connections between the lower and 
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Figure 6: Q\ u as a function of oi^^ 1 for various values of N' (left) and C (right). 

Tij - oo, U ijs (0) = 0, for V i, j, s. 

middle layers were studied. It was interesting to see that for the ratio C = 1 the global 
efficiency depends on the number of individual MGs. By using this formula the indi- 
vidual agents know the number of all MGs. In addition, at least in a broad region of 
the parameters, the degree of symmetry is never zero. Consequently, in contrast to the 
original game, there always exists an optimal strategy for winning the game. 

Second, the connections between the intermediate and the upper levels were inves- 
tigated. For the case of relatively strong local connections, the system seems to behave 
randomly. For strong global coupling the behavior deviates from random behavior, 
and shows a self-organized global behavior, which can be considered a special type of 
'emergent coordination.' 

Finally, the results of the study of the connections between the lower and the up- 
per level also exhibits the property seen previously: for the case of C = 1 the global 
efficiency depends on the number of games. In addition, the global efficiency shows 
interesting dependences both on the values of the ratio number, and on the number of 
games. In the future we intend to investigate these dependences analytically. 
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